Facilitated user interface

ABSTRACT

A facilitated input unit ( 165,170 ), particularly for allowing a disabled person to use a computer ( 100 ). The input unit includes a small display ( 165 ) for showing available input items (such as characters, number, and control keys), which is distinct from a monitor ( 145 ) of the computer; a headset ( 170 ), or other equivalent means, is used to select one of the items and enter the selected item into the system without using the user&#39;s hands, thereby simulating a keyboard ( 155 ) of the computer.

FIELD OF INVENTION

[0001] The present invention relates to a facilitated input unit.

BACKGROUND OF THE INVENTION

[0002] Several types of facilitated input units have been developed inthe recent years, for example for allowing persons with certain physicaldisabilities in their motor functions to use a PC (Personal Computer).These input units do not require use of the hands, and typically controlinteractions with the computer by tracking a user's head and/or eyemovement, as described for example in U.S. Pat. Nos. 4,682,159,5,323,174 and 5,367,315.

[0003] A solution known in the art, particularly useful for enteringinput data by persons also possessing a speech difficulty or disability,is disclosed in U.S. Pat. No. 5,068,645 and consists of showing on amonitor of the computer a keyboard layout. The user moves a cursor to adesired key by slight head rotations; the user then speaks a shortcommand sound to input a character associated with the chosen key intothe computer.

[0004] A drawback of the solution described above is that it requiresmodifications of an existing software controlling operation of thecomputer; particularly, an operating system must be customised in orderto show the keyboard layout (for example in a dedicated window) and toaccept the input characters chosen by the user's head movement.

[0005] Moreover, the window used to show the keyboard layout is alwaysopen and involves wastage of working space on the monitor; this reducesthe amount of information that can be shown simultaneously to the userby active application programs running on the computer.

[0006] It is an object of the present invention to overcome theabove-mentioned drawbacks. In order to achieve this object, afacilitated input unit as set out in the first claim is proposed.

DISCLOSURE OF THE INVENTION

[0007] Briefly, the present invention provides a facilitated input unitfor interacting with a system having a first display for showinginformation to a user, the input unit including means for showingavailable input items and means for selecting one of the items andentering the selected item into the system without using the user'shands, wherein the means for showing includes a second display distinctfrom the first display.

[0008] Moreover, the present invention also provides a computerincluding this input unit, and a corresponding method of interactingwith a system.

BRIEF DESCRIPTION OF THE DRAWINGS

[0009] Further features and the advantages of the solution according tothe present invention will be made clear by the following description ofa preferred embodiment thereof, given purely by way of a non-restrictiveindication, with reference to the attached figures, in which:

[0010]FIG. 1 shows a schematic block-diagram of a computer in which theinput unit of the invention can be used;

[0011]FIG. 2 is a diagrammatical representation of a control box of theinput unit;

[0012]FIG. 3 is a pictorial representation of the computer;

[0013]FIGS. 4a-4 c show different examples of the content of a displayincluded in the input unit;

[0014]FIGS. 5a-5 b are a flow chart of a method used for controlling theinput unit.

DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0015] With reference in particular to FIG. 1, there is shown a computer100, for example a PC (Personal Computer). The computer 100 has severalunits, which are connected in parallel to a communication bus 105. Inparticular, a central processing unit (CPU) 110 controls operation ofthe computer 100, a working memory 115 (typically a DRAM) is useddirectly by the CPU 110, and a read-only memory (ROM) 120 stores a basicprogram for starting the computer 100. Various peripheral units arefurther connected to the bus 105 (by means of respective interfaces).More specifically, a bulk memory consists of a hard disk 125 and of adriver unit (DRV) 130 for reading/writing floppy disks and/or CD-ROMs. Anetwork interface card (NIC) 135 is used to connect the computer 100 toa network (typically the INTERNET).

[0016] An output unit consists of a monitor, or display screen, (DIS)145. A control box (CB) 150 has two inputs for a keyboard (KB) 155 and amouse (MS) 160, respectively. The control box 150 also drives an LCDdisplay (Liquid Crystal Display) 165. A headset (HS) 170 and afoot-switch (FS) 175 are connected to respective further inputs of thecontrol box 150.

[0017] Likewise considerations apply if the computer includes differentunits (such as a printer, a scanner or a web-cam), if the computer has adifferent structure (for example with a multi-processor architecture),and so on.

[0018] Considering now FIG. 2, the control box 150 includes twointerface units (ITF) 203 and 206 for accessing the bus 105;particularly, the interface unit 203 is connected to a standard keyboardport of the computer, while the interface unit 206 is connected to astandard mouse port. Further interface units 210, 215, 220 and 225 areused to connect the keyboard 155, the mouse 160, the headset 170 and thefoot-switch 175, respectively, to the control box 150.

[0019] The interface unit 210 (associated with the keyboard 155) and theinterface unit 215 (associated with the mouse 160) are connected to afirst input of a multiplexer 230 and of a multiplexer 233, respectively;the interface unit 220 (associated with the headset 170) is connected toa second input of both the multiplexers 230 and 233. The multiplexers230 and 233 selectively transfer the signals at their first input or attheir second input to the interface units 203 and 206, respectively,according to a control signal provided by the interface unit 225(associated with the foot-switch 175). The interface unit 220 alsocontrols a driver unit (DRV) 235 for the display 165.

[0020] Operation of the box 150 is managed by a control unit (CTRL) 240;the control unit 240 outputs various control signals that are denoted asa whole with Sc.

[0021] As shown in FIG. 3, the monitor 145 is arranged on a central unit305 of the computer (enclosing the system bus and the units directlyconnected thereto), which in turn rests on a desktop 310; the monitor145 is connected to the central unit 305 by means of a cable not shownin the figure). The control box 150 is positioned on the desktop 310,close to the central unit 305. Two cables 306 and 307 are used toconnect the control box 150 to the keyboard port and to the mouse port,respectively.

[0022] The keyboard 155 and the mouse 160 are arranged on the desktop310, in front of the central unit 305; the keyboard 155 and the mouse160 are provided with a cable 315 and 320, respectively, which isplugged into a connector associated with the corresponding interfaceunit of the control box 150. The display 165 is embedded in a supportelement 325, which replaces a standard base of the monitor 145. Afurther cable 330 connects the display 165 to the respective driver unitof the control box 150.

[0023] A user 335 seats in front of the monitor 145 and the display 165.The user 335 wears the headset 170, which is placed around his head. Theheadset 170 incorporates two mercury micro-switches providing bothlateral and vertical head tracking; particularly, the headset 170detects rotational movements of the user's head, and outputs a digitalsignal for each direction (lateral/vertical) and for each sense (to theleft/right or upwards/downwards), which is asserted when the respectiveangle of tilt of the user's head exceeds a threshold value (for example30°). The foot-switch 175 rests on a floor, close to the user 335. Theheadset 170 and the foot-switch 175 are provided with a cable 340 and345, respectively, which is plugged into a connector associated with thecorresponding interface unit of the control box 150.

[0024] Programs running on the computer 100 often interact with the user335 requiring the entering of input data. For example, the monitor 145simulates a working area (desktop) including a dialog box 355; thedialog box 355 prompts the user 335 to insert some text into arespective fill-in field 360. Normally, the user selects the fill-infield 360 moving a cursor with the mouse 160, and then types the text tobe entered using the keyboard 155. Conversely, a physically disableduser will perform the same operations by using a heads-free, facilitatedinput unit formed by the display 165 and the headset 170 (as describedin detail in the following), which simulates the keyboard 155 and themouse 160.

[0025] With reference now to FIG. 4a, the display 165 consists of anelongated element arranged horizontally. The display 165 is used to showavailable input items consisting of symbols (such as alphanumericcharacters, special characters, and control keys as TAB, END, CANC,PAGEUP, PAGEDONW, F1-F12) and a main menu identifier; the items arearranged in a wrap-around sequence, which is scrollable horizontally. Asubset of the items (consisting of seventeen items in the example atissue) is simultaneously shown as an array on the display 165; a currentposition along the subset(character E) is underscored.

[0026] As shown in FIG. 4b, the main menu includes a series of options;the menu options are arranged in a first-level list, which is scrollablevertically. The menu options consist of commands or cascading menuidentifiers. Each cascading menu (such as the one denoted with “Chars”in the figure) includes a further series of commands; as shown in FIG.5c, the commands are arranged in a second-level list, which isscrollable horizontally. Preferably, the menu options of the first levellist are used to define the input symbols, for example only alphanumericcharacters (with a corresponding cascading menu for selecting only theupper case, only the lower case or both of them), only numbers, onlyspecial characters, only control keys, or all of them. Moreover, acascading menu is used to select mouse functions, such as movingupwards/downwards or to the left/right of a position segment (‘mickey’),and clicking on the left, central or right button.

[0027] Similar considerations apply if the control box is replaced byanother equivalent device, if some of its operations are implemented bysoftware, if the display is of a different type (for example a LEDdisplay) or has a different shape, if a different threshold value forthe user's head angle of tilt is employed, if the programs running onthe computer have a different user interface, if the current position isdenoted in a different manner (for example with a blinking), and thelike.

[0028] Considering now FIGS. 5a-5 b, when the computer is switched on adriver module managing operation of the control box runs a method 500which starts at block 503 and then goes to block 506, wherein it checkswhether the foot-switch has been actuated. If so, a mode of operation ofthe control box is switched at block 509 between a normal mode and afacilitated mode (set as a default at the beginning); the method thenpasses to block 512. Conversely, the method continues to block 512directly

[0029] The method verifies at block 512 the mode of operation of thecontrol box. If the control box is set to operate in the normal mode,the method proceeds to block 515, wherein the interface unit of theheadset and the driver unit of the display are disabled; at the sametime, the multiplexers are controlled to transfer the input datareceived from the interface units associated with the keyboard and themouse, respectively. In this way, the user moves the cursor with themouse and types input data with the keyboard as usual (being the controlbox completely transparent to the computer). The method then descendsinto block 518 (described in the following).

[0030] On the contrary, if the control box is set to operate in thefacilitated mode (block 512), the method goes to block 521, wherein theinterface units of the keyboard and the mouse are disabled, and both themultiplexers are controlled to transfer the input data received from theinterface unit associated with the headset. Passing to block 524, asubset of the input items is shown on the display; at the beginning, thesubset consists of the first seventeen alphanumeric characters(uppercase and lowercase), and the current position is set to the oneassociated with the central character of the subset.

[0031] A verification is then made at block 527 whether the user's headhas been moved laterally (that is whether one of the correspondingsignals provided by the headset is asserted). If not, the methodcontinues to block 530 (described in the following). Conversely, themethod checks at block 533 the item associated with the currentposition. If the current position is associated with a menu option ofthe first level list, the method goes to block 536. A verification ismade at block 536 on the sense of the detected movement of the user'shead. If the user's head has been rotated to the left the methoddescends into block 539, wherein the menu option is selected andhighlighted on the display (if non-selected) or the correspondingoperation is executed (if the menu option is already selected);particularly, when the option is the identifier of a cascading menu, therespective second-level list is opened and shown on the display.Conversely, if the user's head has been rotated to the right the methoddescends into block 542, wherein the menu option is deselected (ifselected) or the first level list is closed returning to the main menuidentifier (if the menu option is not selected). In both cases, themethod then passes to block 530.

[0032] Referring back to block 533, if the current position isassociated with an input symbol, the main menu identifier or a commandof the second level list, the method proceeds to block 545; averification is made at block 545 whether the current position hasreached any end of the array (that is a first or a last position). Ifthe current position has reached an end of the array, the methodcontinues to block 548, wherein the items are caused to scrollhorizontally (in a wrap-around manner) according to the sense of thedetected movement of the user's head (to the left or to the right); inthis way, a new item appears on the display, with the other items movingof one position (so that one item disappears). Preferably, if all themenu options available in the current second level list fit into thedisplay, the scrolling is disabled. Conversely, if the current positionhas not reached any end of the array (block 545), the method proceeds toblock 551, wherein the current position is moved of one item to the leftor to the right according to the sense of the detected movement of theuser's head. In both cases, the method then goes to block 530.

[0033] A verification is then made at block 530 whether the user's headhas been moved vertically. If not, the method descends into block 518directly. Conversely, the method checks at block 554 the item associatedwith the current position. If the current position is associated with amenu option of the first level list, the method goes to block 557,wherein the menu options are caused to scroll vertically (in awrap-around manner) according to the sense of the detected movement ofthe user's head (upwards or downwards); in this way, a new menu optionappears on the display, replacing the one currently shown. The methodthen passes to block 518.

[0034] On the contrary, if the current position is associated with aninput symbol, the main menu identifier or a command of the second levellist (block 554), the method proceeds to block 560; a verification ismade at block 560 on the sense of the detected movement of the user'shead. If the user's head has been rotated upwards, the method goes toblock 563, wherein the item is selected and highlighted on the display(if non-selected) or the corresponding operation is executed (if theitem is already selected). Particularly, when the item is an inputsymbol this is entered into the computer (simulating a hit of acorresponding key on the keyboard), when the item is the main menuidentifier the first level list is opened and its first option is shownon the display, and when the item is a command of the second level listthe corresponding operation is executed. Conversely, if the user's headhas been rotated downwards the method descends into block 542, whereinthe item is deselected (if selected) or the second level list is closedreturning to the respective identifier (if the menu command is notselected). The method then descends into block 518.

[0035] The method checks at block 518 if the computer has been shutdown. If not, the method returns to block 506 (for repeating the stepsdescribed above). On the contrary, the method ends at the final block569.

[0036] Likewise considerations apply if the driver module controllingthe box implements an equivalent method, for example with the inputsymbols selected/deselected with the upwards movement and entered intothe computer with the downwards movement, with error signals, and so on.

[0037] More generally, the present invention provides a facilitatedinput unit for interacting with a system having a first display forshowing information to a user; the input unit includes a second display(distinct from the first display) for showing available input items andmeans for selecting one of the items and entering the selected item intothe system without using the user's hands.

[0038] The solution of the invention makes it possible to communicatewith the system, and particularly with an operating system of thecomputer, in the same manner as a conventional keyboard and mouse.Therefore, the computer may be used with all presently availablesoftware applications, without requiring any customisation.

[0039] Moreover, the showing of the items does not involves any wastageof working space on the monitor, so that the whole desktop is availablefor use by other programs as usual.

[0040] The preferred embodiment of the present invention described aboveoffers further advantages. Particularly, the display only shows ascrollable subset of the items simultaneously. This makes the displayand the controlling hardware/software very simple and inexpensive. Thearrangement of the items in a wrap-around sequence further facilitatesthe use of the input unit.

[0041] Likewise considerations apply if the display is arrangedvertically, if the items are scrollable only in a single sense, if awhole line is scrollable at a time. Alternatively, the input unit doesnot feature any scrolling (for example with the display showing akeyboard layout), or the items are arranged in a non-wrap-aroundsequence.

[0042] The use of a single array of items provides a very compactstructure, which is particularly easy to use (even by persons with a nonperfect control of their head movement). Advantageously, the input unittracks the user's head movement; the detected movements along a firstdirection (such as laterally) control scrolling of the items on thedisplay, while the detected movements along a second direction (such asvertically) control selecting/deselecting and entering of the items.This feature is particularly advantageous when the user is non properlyspeaking, or completely dumb. Moreover, the menu options allow the userto change the input items shown on the display according to a specificapplication (for example only alphanumeric characters when using a wordprocessor or only numbers when using a spread-sheet).

[0043] Similar considerations apply if scrolling and/or selecting of theitems is controlled by different movements of the user's head (forexample forward and backward), if the movement of the user's head isdetected by different sensors (for example ultrasonic or lighttransceivers), if the sensors are embedded in a frame for glasses, if anabsolute value of an orientation of the user's head is detected, if themenu options are organised in a different manner (for example with twoor more menus or with a different number of levels, down to a singlelevel menu), if the input items are defined by using correspondingfoot-switches, and the like.

[0044] Alternatively, the input unit is driven by the user's eyemovement, which is detected by reflection of light from the eyes (with amore complex structure, but which does not require the user to wear anyspecial hardware), by a set of foot-switches (with a more effectivestructure, but which cannot be used by a completely paralysed person),or by a movement of any other portion of the user's body. However, thesolution of the present invention leads itself to be carried out evenwith two or more lines of items shown simultaneously on the display,with a display accommodating a single item at a time, with selection ofthe items driven by a voice detector, or without any menu for definingthe items.

[0045] The control box simulates operation of a standard keyboard andmouse, irrespective of the origin of the input data. This allows theinput unit of the invention to be used without any modification ofexisting hardware, and without the need to plug/unplug devices for thenormal and facilitated usage.

[0046] Likewise considerations apply if the control box has a differentstructure, if the various connections with the central unit of thecomputer are of a wireless type, if the foot-switch is replaced by adifferent actuating switch (for example in the support base embeddingthe display), and so on; however, the solution of the present inventionleads itself to be implemented even replacing the control box with acorresponding board plugged into a slot of the bus, or with dedicatedports of the computer for the headset and the display.

[0047] Advantageously, the input unit of the invention is used forentering data into a computer, particularly by persons that are not ableto use their hands to control the keyboard and the mouse. This involvesa real way to interact with the computer directly, for example allowingdisabled persons to travel virtually using the INTERNET. Preferably, thedisplay is embedded in a support element of the monitor, so that theset-up of the input unit simply involves replacing the standard base ofthe monitor with this support element.

[0048] Alternatively, the input unit according to the present inventionis used in a different application (such as for controlling a set-topbox or a TV set), or the display is arranged elsewhere (for exampleresting on the monitor).

[0049] Naturally, in order to satisfy local and specific requirements, aperson skilled in the art may apply to the solution described above manymodifications and alterations all of which, however, are included withinthe scope of protection of the invention as defined by the followingclaims.

What is claimed is:
 1. A facilitated input unit for interacting with a system having a first display for showing information to a user, the input unit including a second display distinct from the first display for showing available input items and means for selecting one of the items and entering the selected item into the system without using the user's hands.
 2. The input unit according to claim 1, wherein a subset of the items are simultaneously shown on the second display, the input unit further including means for scrolling the items on the second display.
 3. The input unit according to claim 2, wherein the items are ordered in a sequence, the means for scrolling causing the items to wrap around the sequence.
 4. The input unit according to claim 2, wherein the subset consists of a plurality of items arranged in an array having a first and a second end, the input unit further including means for providing an indication of an active position along the subset, and wherein the means for scrolling includes means for detecting a movement of a portion of the user's body along a first direction, the active position moving along the subset in response to the detected movement along the first direction and the items scrolling on the second display after the active position reaches the first or the second end of the array.
 5. The input unit according to claim 4, wherein the means for selecting includes means for detecting a movement of the portion of the user's body along a second direction, the item corresponding to the active position being selected/deselected and entered into the system in response to the detected movement along the second direction.
 6. The input unit according to any claim from 1, further including means for selectively defining the available input items.
 7. The input unit according to claim 1, further including a control device having an input for connection to the means for selecting, at least one further input for connection to a hand-driven further input unit of the system, an output for connection to the second display, at least one further output for connection to the system, and means for selectively transferring input data from the input unit or from the further input unit to the system.
 8. A facilitated input unit for interacting with a system having a first display for showing information to the user, the input unit including a second display distinct from the first display for showing available input items and a selecting device for selecting one of the items and entering the selected item into the system without using the user's hands.
 9. A computer comprising a central unit, a first display for showing information to a user, an input unit including a second display distinct from the first display for showing available input items and means for selecting one of the items and entering the selected item into the system without using the user's hands, and means for connecting the input unit to the central unit.
 10. The computer according to claim 9, further comprising a support element for the first display, the second display being embedded in the support element.
 11. A method of interacting with a system having a first display for showing information to a user, the method including the steps of: showing available input items to the user on a second display distinct from the first display, and selecting one of the items and entering the selected items into the system without using the user's hands. 